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AMENDMENTS TO THE DRAWINGS 

The attached sheet(s) of drawings includes changes to . 

Subject to the approval of the Examiner, please replace the drawing sheets including Figs. 3, 
5, and 6 with the attached replacement drawing sheets. 
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REMARKS 

In the Office Action, the Examiner objected to the drawings and rejected claims 1-28 under 
35 U.S.C. § 102(e) based on U.S. Patent No. 6,624,826 to Balabanovic (herein referred to as 
"Balabanovic"). 

Regarding the objection to the drawings, Applicants' representative discussed the objection 
in a telephone conversation with the Examiner on July 30, 2007. In the telephone conversation, the 
Examiner clarified that the objection was based on Replacement Drawings submitted on March 19, 
2004 by Applicants. The Examiner stated that replacement sheets Figs. 3, 5, and 6 were not 
submitted in accordance with 37 CFR § 1.121(d). Applicants submit herewith another copy of the 
replacement sheets for Figs. 3, 5, and 6. These drawings are generally identical to the originally 
filed versions of Figs. 3, 4, and 6, except that the line quaUty has been improved to conform to 37 
CFR § 1.84(1). 

Applicants respectfully traverse the claim rejections based on Balabanovic. 

Claim 1 is directed to a speech transcription tool that includes control logic configured to 
play back portions of an audio stream, an input device, and a graphical user interface. The input 
device is configured to receive text fi'om a user defining a transcription of the portions of the audio 
stream and receive annotation information fi'om the user fiirther defining the text. The graphical 
user interface includes a first section configured to display a graphical representation of a waveform 
corresponding to the audio stream, and a second section configured to display the text and 
representations of the annotation information for the text. Balabanovic does not disclose or suggest 
each of the features recited in claim 1. 

Balabanovic describes the generation of visual representations for audio documents. 
(Balabanovic, Title.) In one, implementation, Balabanovic describes an "audio gauge [that] 
increases in size in proportion to the amount of audio recorded while the audio gauge is active." 
(Balabanovic, Abstract.) According to Balabanovic, the audio gauges may be used so that "one can 
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record a variable-length audio narration that may optionally describe one or more electronic 
documents or images displayed upon a display device." (Balabanovic, col 5, lines 11-13.) 

The disclosure of Balabanovic is generally unrelated to a speech transcription tool and 
certainly does not disclose or suggest, as is recited in claim 1, an input device configured to receive 
text from a user defining a transcription of the portions of the audio stream and receive annotation 
information from the user fiirther defining the text. Allowing a user to record an audio narration 
that corresponds to a document, as described by Balabanovic, is not reasonably related to an input 
device configured to receive text from a user defining a transcription of portions of an audio stream, 
as recited in claim 1. Further, Balabanovic also does not disclose or suggest receiving annotation 
information from the user fiirther defining the text, as is also recited in claim 1 . 

Li rejecting claim 1, the Examiner points to column 8, lines 16-32 of Balabanovic as being 
relevant to this feature of claim 1. (Office Action, page 3.) This section of Balabanovic states: 

A multimedia chronicle is a particular type of audio narrative that includes a singular 
narration thread and one or more references to various types of electronic documents. 
Multiple sub-chronicles, each containing a singular narration thread, may be 
combined to form a larger multimedia chronicle. Within a multimedia chronicle it is 
possible for one or more persons to describe various types of electronic documents 
including, for example, but not limited to, a Web page with hyperlinks, a slide show 
containing audio narration, a text document containing text annotations, a scanned 
document image, a word processor document, a presentation, etc. The references 
may refer to the contents of the entire electronic document or to a specific area 
within the electronic document. A linear ordering of sub-chronicles may also be 
specified allowing them to be played back in a default order. 

This section of Balabanovic describes the concept of a "multimedia chronicle." According to 
Balabanovic, a muhimedia chronicle allows one or more persons to describe various types of 
electronic documents. Allowing a user to "describe" electronic documents via an audio narrative, as 
discussed by Balabanovic, in no way discloses or suggest the transcription tool of claim 1, which 
includes an input device configured to receive text from a user defining a transcription of the 
portions of the audio stream and receive annotation information from the user fiirther defining the 
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text. Providing an audio narrative of an electronic document is simply not related to receiving text 
defining a transcription of an audio stream, as recited in claim 1. 

For at least these reasons, Applicants submit that Balabanovic does not disclose or suggest 
each of the features recited in claim 1 and therefore, the rejection of claim 1 based on Balabanovic 
is improper and should be withdrawn. The rejection of claims 2-9 based on Balabanovic should 
also be withdrawn, at least by virtue of the dependency of these claims fi:om claim 1, either directly 
or directly. 

Claims 2-9 recite additional features that are not disclosed or suggested by Balabanovic. 
Claim 2, for example, recites that the graphical user interface of claim 1 includes a third section 
configured to display a hierarchically structured representation of the text. Balabanovic also does 
not disclose or suggest this aspect of claim 1. Nowhere does Balabanovic disclose or suggest a 
hierarchically structured representation of text, much less such a representation of the text recited in 
claim 2, which refers to, as recited in claim 1 ''text from a user defining a transcription of the 
portions of the audio stream." hi rejecting claim 2, the Examiner points to Fig, 4B of Balabanovic. 
(Office Action, page 3.) Neither Fig. 4B of Balabanovic nor the corresponding description in 
Balabanovic in any way relate to display of a hierarchically structured representation of text, Li 
fact, Balabanovic never even mentions the term "hierarchical," much less displaying text in the 
manner recited in claim 2. For this reason also, the rejection of claim 2 is improper and should be 
withdrawn. 

Dependent claim 5 fiirther recites that the input device receives information from the user 
classifying the portions of the audio stream into a plurality of hierarchical segments. Balabanovic 
also does not disclose this feature. In rejecting claim 5, the Examiner points to column 8, lines 38- 
52 of Balabanovic. (Office Action, page 4.) This section of Balabanovic defines a narrative thread 
as a stream of recorded audio that follows a given theme or discussion topic. Li Balabanovic, a user 
may record a narrative stream relating to an electronic document that another user may find usefiil 
when viewing the electronic document. The fact that a user of a device based on Balabanovic *s 
disclosure may record a narrative stream, however, in no way discloses or suggests an input device 
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that receives information from a user classifying portions of an audio stream into a plurality of 
hierarchical segments , as recited in claim 5. For this reason also, the rejection of claim 5 is 
improper and should be withdrawn. 

Dependent claim 6 further defines the features of claim 5 and recites that the segments 
include speaker tums, sections, and episodes. Balabanovic does not disclose this feature of claim 6. 
As mentioned with respect to claim 5, Balabanovic does not disclose classifying portions of an 
audio stream into a plurality of hierarchical segments, and Balabanovic certainly does not disclose 
or suggest, as recited in claim 6, that the segments include speaker tums, sections, and episodes. 
For this reason also, the rejection of claim 6 is improper and should be withdrawn. 

Independent claim 10 and its dependent claims 11-18 also stand rejected under 35 U.S.C. § 
102(e) based on Balabanovic. 

Claim 10 is directed to a method that includes receiving an audio stream containing speech 
data; receiving text from a user defining a transcription of the speech data; receiving annotation 
information from the user ftirther defining the text; displaying the text; and displaying symbolic 
representations of the annotation information with the text. Balabanovic does not disclose or 
suggest each of the features recited in claim 10. 

Balabanovic, for example, does not disclose or suggest receiving text from a user defining a 
transcription of the speech data. As previously discussed, Balabanovic relates to the recording and 
playback of audio data that corresponds to a document. Recording audio to describe a document is 
not reasonably related to receiving text from a user defining a transcription of speech data, as recited 
in claim 10. 

Claim 10 fiirther recites receiving annotation information from the user ftirther defining the 
text (i.e., the text received from the user defining the transcription of the speech data). Balabanovic 
also does not disclose or suggest this aspect of claim 10. 
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The Examiner appears to contend that column 8, hnes 16-32 of Balabanovic is relevant to 
these features of claim 10. These sections of Balabanovic were discussed previously with respect to 
claim 1. As discussed, this section of Balabanovic describes the concept of a "multimedia 
chronicle" that allows one or more persons to describe various types of electronic documents. A 
multimedia chronicle, however, simply does not disclose or suggest, as recited in claim 10, 
receiving text from a user defining a transcription of speech data and receiving annotation 
information from the user fiirther defining the text. 

For at least these reasons, Applicants submit that Balabanovic does not disclose or suggest 
each of the features recited in claim 10 and therefore, the rejection of claim 10 based on 
Balabanovic is improper and should be withdrawn. The rejection of claims 11-18 based on 
Balabanovic should also be withdrawn, at least by virtue of the dependency of these claims from 
claim 10, either directly or directly. 

Claims 11-18 recite additional features that are not disclosed or suggested by Balabanovic. 
Claim 15, for example, recites that the method of claim 10 fiirther includes categorizing the audio 
stream into a plurality of hierarchically arranged segments and displaying the hierarchically 
arranged segments. Balabanovic does not disclose or suggest these features of claim 15. Nowhere 
does Balabanovic disclose or suggest hierarchically arranged segments of audio, much less 
categorizing the audio stream into a plurality of hierarchically arranged segments and displaying the 
hierarchically arranged segments. The Examiner does not explicitly address the features of this 
claim. If the Examiner persists in the rejection of this claim, AppHcants request that the Examiner 
specifically point out how the Examiner is interpreting Balabanovic to disclose the features of claim 
15. For this reason also, the rejection of claim 15 is improper and should be withdrawn. 

Independent claim 19 and its dependent claims 20-24 also stand rejected under 35 U.S.C. § 
102(e) based on Balabanovic. 

Claim 19 is directed to a computing device for transcribing an audio file that includes 
speech. The computing device includes an audio output device; a processor; and a computer 
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memory coupled to the processor. The computer memory includes programming instructions that 
when executed by the processor cause the processor to: play a current one of a plurality of segments 
of the audio file through the audio output device; receive transcription information for speech 
segments of the segments of the audio file played through the audio output device; receive 
annotation information relating to the transcription information; display the transcription 
information in an output section of a graphical user interface; and display the annotation 
information as graphical icons in the output section of the graphical user interface. Balabanovic 
does not disclose or suggest each of the features recited in claim 19. 

Balabanovic, for example, does not disclose or suggest receiving transcription information 
for speech segments of the segments of the audio file played through the audio output device. As 
previously discussed, Balabanovic relates to the recording and playback of audio data that 
corresponds to a document. Recording audio to describe a document is not reasonably related to 
receiving transcription information for speech segments, as recited in claim 19. 

Claim 19 fiirther recites receiving annotation information relating to the transcription 
information. Balabanovic also does not disclose or suggest this aspect of claim 19. 

The Examiner appears to contend that column 8, lines 16-32 of Balabanovic is relevant to 
these features of claim 19. These sections of Balabanovic were discussed previously with respect to 
claim 1. As discussed, these sections of Balabanovic describe the concept of a "multimedia 
chronicle" that allows one or more persons to describe various types of electronic documents. A 
multimedia chronicle, however, simply does not disclose or suggest, as recited in claim 19, 
receiving transcription information for speech segments of an audio file played through an audio 
output device and receiving annotation information relating to the transcription information. 

For at least these reasons, AppUcants submit that Balabanovic does not disclose or suggest 
each of the features recited in claim 19 and therefore, the rejection of claim 19 based on 
Balabanovic is improper and should be withdrawn. The rejection of claims 20-26 based on 
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Balabanovic should also be withdrawn, at least by virtue of the dependency of these claims from 
claim 19, either directly or directly. 

Independent claims 27 and 28 also stand rejected under 35 U.S.C. § 102(e) based on 
Balabanovic. Independent claims 27 and 28 each recite features similar to, although different in 
scope than, those recited in independent claims 1 and 10. Accordingly, based on rationale similar to 
that given above for claims 1 and 10, Applicants submit that the rejections of claims 27 and 28 
based on Balabanovic are also improper and should be withdrawn. 

Conclusion 

In view of the foregoing remarks, Applicants respectfully request the Examiner's 
reconsideration of the appHcation and the timely allowance of the pending claims. 

As Applicants' remarks with respect to the Examiner's rejections are sufficient to overcome 
these rejections, Applicants' silence as to certain assertions by the Examiner in the Office Action or 
certain requirements that may be applicable to such rejections (e.g., whether a reference constitutes 
prior art, motivation to combine references, assertions regarding dependent claims, etc.) is not a 
concession by AppUcants that such assertions are accurate or such requirements have been met, and 
Applicants reserve the right to analyze and dispute these assertions/requirements in the future. 
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Applicants believe no fee is due with this response. However, if a fee is due, please charge 
our Deposit Account No. 18-1945, under Order No. BBNT-POl-195 from which the undersigned is 



authorized to draw. 



Dated: August 6, 2007 



Respectfully submitted. 
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